DOCUMENT RESUAE 


ED 137 788 CS 203 281 

AUTHOR : Greenbaum, Sidney 

TITLE Acceptability Experiments: Compliance and Evaluation 
Tests. 

INSTITUTION Wisconsin Univ., Milwaukee. 

PUB DATE (76) 

NOTE 42p. 

EDRS PRICE MF-$0.83 HC-$2.06 Plus Postage. 

DESCRIPTORS *College Students; Educational Research; *Evaluation; 


Higher Education; Semantics; *Sentences; *Syntax; 
Test Construction; *Testing; Test Results; *Tests 


ABSTRACT 

This paper discusses the use of compliance tests and 
evaluation tests in two experiments dealing with specific questions 
of acceptability in English syntax. The experiments, conducted in 
1970 at the University of Wisconsin--Milwaukee, involved 
‘undergraduate students in their third or fourth years. The compliance 
tests, which are operation oriented and require that a task be 
performed on a sentence, were given before the evaluation tests, 
which elicit attitudes and require an explicit judgment on the 
acceptability of a sentence. The results of both tests are discussed 
and compared for the following: intensifiers, disjuncts, time 
adverbs, adjectives in extraposed ("it") clauses, adjective clauses, 
coordination ellipsis, and jumbled sentences. Tables of restlts, and 
appendixes which include some of the tests and instruction sheets are 
attached. (LL) 
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The exneriments described here deal with specific questions of ac= 


centability in English syntax. The results were taken into account dur- 


ing the writing of the reference grammar by Quirk et al. 1972 and its 


derivative by Quirk and Greenbaum 1973. 


» 


Two experiments (UWMa and UWMb) were conducted in 1970 ‘at the Uni- 


versity of Wisconsin-Milwaukee. The experiments incorporated various 


types of tests, some of which have been described elsewhere (Greenbaum 


1374, 1976, in press a and b). This paper reports on the 


evaluation tests (Greenbaum and Quirk 1970, 1-14). valuation tests elicit 


compliance and 


attitudes; they require an explicit judgement. on the neceptabtlity, of a 


sentence. Compliance tests, on the other hand, are operation tests they 


require thee. a task be performed on a sentence, 


The subjects were undergraduate students (all native 


English) in their third or fourth years at the university: 


speakers of 


81 in UWa 


and 96 in web. They were predominantly female and from Wisconsin and 


neighboring states. - 


*The work was supported by grants from the Graduate School Research 


Committee of the University of ‘iisconsin-Milwaukee. For their help in 


administering the exneriments and in scoring the results I 


to Jacquelyn Biel and Paul Portland. 
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Appendix I contains four Tables listing the material used in the 


experiments and a summary of the results. Tables 1 and 2 present the two 
batteries of compliance tests, the first for UWMa and the second for UWMb, 
while Tables 3 and-4 present the conbedpondtng batteries of evaluation 
tests. Individual: tests and sentences are referred to by a combination 
aorb (ise. UWMa or UWMb) plus a numeral denoting the list number in 
Tables 1-/,. A compliance test and its corresponding evaluation test are 
Linked by having the same reference, The first column in Tables 1 and 

2 lists the test sentences, while the second column lists the tasks. 

N with a superscrint indicates that subjects were required to replace the 
relevant, noun by the listed noun: for example, in Table 1, sentence 1 
the instruction was 'Replace price by prices’. The last columns pive the 
number of relevant Honnompltancés (RNC) in the responses and their per- 
cathans for the total number of subjects. When totals for noncompliance 
scores are piven, the intention is always RNC scores. RNC scores comprise 
total omissions and changes that evade the linguistic problem under in— 


vestigation (Greenbaum and Quirk 1970, 20). For example, in Table l, 


sentence 1 the problem was the acceptability of practically between aux- 
iliary and main verb: omission of practically or the auxiliary, substi- 
tution of another adverb, and transposition of practically constitute 
RNC chanpes; thie -shatpas provide some indication of the extent to which 


subjects. are unhappy with practically in that position. 


[In Tables 3 ani 4 the first four symbols in the columns following 


we sentences give the totals for the four responses allowed to subjects: 


; ) | 
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perfectly natural and normal 

wholly unnatural or abnormal ime 
somewhere between these two extremes ('a bit dubious’, 
perhaps) 

not sure 


bb +t 


~ 


The symbol "/' indicates failure to respond. ‘ 


c) 


Procedures were the same in both experiments. The compliance battery 
was given before the evaluation battery to avoid giving subjects ‘ie im- 
pression that they were being asked to evaluate the sentences in the com- 
nliance tests. Four practice compliance tésts were presented at the be-. 
pinning of the battery. ‘ 

The tests were given:to subjects individually and were randomized °' 
afresh for each subjéct. > Tn both the compliance and the evaluation tests 
the material was presented visually and the subjects responded me wating” 


Zach compliance test appeared on a separate slide that was projected onto 


Sy 


a small screen in front of the subject: the slide was visible for three 
seconds and the subject then had 15 seconds in which to write down his 
* response. ° For the evaluation Sonisabwibs the subject was given a book- 
let, on each ae of which there was a sentence for eitlination, He was 
allowed five seconds for recording his response before being told to turn 


to the next, page. The subject was asked to read an instruction sheet 


before each component. The instruction sheets are in Appendix IT. 


I: INTENSIFIERS 


RNC 
Compliance ‘ Scores Percent 


al. The price has practically doubled. ns prices 16 20 
a2. The price pra€tically has doubled. Ns prices 43 53 
a3. He could hardly sit still. nis they . 1 1 
ale He hardly could sit stall. wi: they 42 52 
a5. He badly needed the money. : they — 14 17 
a6. I despise him utterly. past 13 16 ; 
a7. TI utterly despise him. past 1 1 
a8. His arrival was utterly expected. present 2h 30 
all. The car certainly broke down question i. 53 
al7. You-will surely believe him. negative 71 88 
-al8, You will certainly want this. negative 73 90 
b8, They greatly admire his courage. question 8 8 
bY. They utterly hate that course. question LE 11 
b1U. He humbly presented his apologies. question 15 16 
Evaluation + - 3 7 / 
al. The prices have practically doubled. 79 (99%) 1(1%) Oo sae 
a2, The prices practically have doubled. 39 (48%) 14 (17%) 28 (35%) O O 
a3. They could hardly sit still, 80 7 0 1 (1%) 0 0 
aye They hardly could sit still. 41 (52%) 12 mee 25 (329) 2 2 
a5, They badly needed the money. 52 (44%) 7 (9%). 22 (27%) 0 0 
ab. T despised him utterly. 46 (57%) 9 ri 25 (31%) 1 0 
a7. I utterly despised him. 7h (91%) . 2 (2%) 5 (6%) O 0 
a%, His. arrival is utterly expected. 21 268) 27 ey 29 (36%) 4 O 
all. Did the car certainly break down? 7 (9%) 29 (36%) 43 (54%) 1 1 
al7. You won't surely believe him - 14 (17%) °23 ee 42 (52%) 1 1 
= al’, You won't certainly want this. 16 (20%) 26 (33%) 37 (47%) O 2 
ba. Jo they greatly admire his courage? 65 (71%) 6 tee 20 es sae 
bh). Uo they utterly hate that course? 53 (56%) 11 (12%) 25 (27%) 5 2 
b19, Did he humbly present his apologies? 65 (70%) 10 (11%) 17 (18%). 1 3 
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Intensifiers have a heightening or lowering effect ‘on the force of 
the verb ‘ef. Greenbaum 1969, 127-147; Greenbaum 1970, 23-32; Polinger 
1972, 160-175, 192-2443; Quirk-et al. 1972, 8.19-33). Three groups of 
intensifiers appeared in the experiments: 
(a) ‘downtoners, e.g. hard 
(b) amplifiers, e.g. preatly 
(c) emphasizers, e.f. certainly rg, 
Tests al-a8 concerned the positions of intensifiers in declarative 
sentences: in al-ai the downtoners hardly and practically were. beptced mth, ay be, 


for the acceptability of the positions before and after an auxiliary, 

the auxiliary being could with hardly and have with practically. For 
both downtoners the norm is post-auxiliary. In compliance test a3, apart 
from one failure to respond, all subjects retained iigodiy 5 the position 
given to them: could hardly sit. On the other hand, in compliance test 
al, where they were given hardly could sit, 41 subjects transposed hardly 
to post-auxiliary. ‘Beatnabton tests a3 and ai corroborate the compliance 
cents: thane is near-unanimity in fully accepting hardly in post-auxiliary 
position, whereas there are many objections to the pre~auxiliary position. 
The evaluation tests for practically (al and a2) closely parallel those 
for hardly, but there are some differences in the compliance tests. In 
al, 16 of the subjects (20%) failed to place practically in the required 
post-auxiliary position: hee practically doubled. In a few instances 
there were omissions of ‘practically, the lexical verb, or the auxiliary; 
however, ten of the changes were replacements of practically by another 


adverb, mostly actually. The replacement suggests that the main problem 
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for those subjects was weer the position of the downtoner; it was that 

they regarded practically as an annie downtoner or its collocation with 
doubled as unusual. [n a2, on the other hand, there was another problem 
that took precedence: pre-auxiliary position of the downtoner was felt 

to be ‘leviant. Hence, 35 subjects — most of those that failed to comply - 
transmsed practically to post-auxiliary position. For hardly we have 
corroborating evidence from a word-placement test which required subjects 
to glace hardly in the position that seemed most natural and normal to 
them in the sentence He could sit still (Greenbaum 1975). Post-auxiliary 
position was selected by almost everybody. In addition, there is compar- 
ative information from compliance and evaluation tests on both. hardly 

and practically with. Aritish speakers. The results also showed that post- 
auxiliary position was the norm for both downtoners (Greenbaum and Quirk 


1370, 121 and 131).° 


Radly is a booster, a subcategory of amplifiers denoting a high degree 
(wirk et al. 1777, 3.2327). In a5, badly is positioned before the verb. 
The evaluation test showed that over a third of the subjects are unhappy 
with the sentence They badly needed the money. The compliance test nin- 
nointed the eda for their dissatisfaction: ten subjects moved badly 
to Lhe end of the sentence. corroboration also comes from a word=-placement 
test requirinsg baily to be used with He needed the money: 74% selected 
final position and only 4% nreverb position (Greenbaum 1976). Similarly, 
when in a oreference test subjects were asked to rate the accentability 
of both He needed the money baily and He badly needed the money, the for- 
mer was fully accepted by 77% and the latter by only 46% Hoveveity. Beltish 
speakers seem to accept the preverb nahin, When compliance test a5 
was eiven to undergraduates at a British university, none transposed badly 


(Greenbaum 1970, S4fe). 
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Utterly belongs to the maximizer subcatesory of amplifiers (Quirk 
et al. 1972, 3.23227), ienoting an upper extreme. Compliance and eval- 
uation tests ab and a7 demonstrate that the apeteured position for utterly 
is shaven: a in I utterly despised him. In the compliance test ab, ; 
13 subjects transposed utterly to preverb, while there were no transpo-~ 
sitions of preverb utterly in ay. We find congruent evidence in two word- 
placement tests: in one 89 subjects (93%) selectéd preverb position, ; 
responding with I utterly despise them; in the other, 52 (90%) responded 


with They all utterly hate that course (Greenbaum 1976). 


In comnliance test a8 utterly is preverb iene kareet sentence His 
arrival is utterly expected, the normal position, ani therefore there : 
were no transpositions of-the booster. The lfnawistic problem was thought - | 
to be the deviance of the collocation of utterly with expect, since utterly 
tends to collocate with items that have some ‘negative’ implication (Green- 
baum 1970, 5055, 73-75). Dissatisfaction would therefore be expressed 
by omission of the booster or the verb or by replacement of the booster 

- or the verb. In fact, 9 subjects omitted utterly and 5 omitted expected; 
5 replaced utterly with other adverbials (certainly, most, early (placed 
finally), every day, presently ] and 3 cackaunl expected (unexpect 1 twice, 
late). Dissatisfaction with the collocation utterly expected is presum- 


‘ably reflected in the low acceptability rating given to the sentence in 


evaluation test a3, 


‘ 


The acceptability of the intensifier certainly in a question wine 
tested in comoliance test all. The noncompliances indicated that the 
deviance was felt to involve certainly and the question form'of the sen- 
tence: 30 omitted certainly, % replaced it with other synonymous forms 
fs} He, = 
q 


(really, for certain, and a restructuring with Is it certain...), and % 


3 left the sentence as a declarative. The deviance in the sentence is 
recorded in the very low acceptability rating given in all. ‘Similar re- 
sults_were obtained from British subjects (Greenbaum and Quirk 1970, 125 


« 


The intensifiers surely and certainly do not come within the domain Bs 
of clause negation. This can be demonstrated through the failure of sub- 
jects to retain these intensifiers in pre-verb position when the sentence 
is. nepated, though they retain the intensifier really as pre-verb (ef. 
Greenbaum 1949, 136-138). The compliance tests al7 and al% produced a 
large number of transpositions, for both intensifiers mainly ‘to pre-auxiliary 
and pre-nerative shikios Thus, of the 71 noncompliances for surely, 

30 (37%) were transpositions of the intensifier before the auxiliary and 

2), (30%) before the negative particle; for the es noncompliances for cara. 
the respective figures are 40 (494%) and 22 (27%). The acceptability ratings 
for both You won't surely believe him and You won't certainly want this 

_.are low. In a similar compliance test with British subjects, where the 
sentence to be negated was He can certainly drive a car, almost all trans- 
posed certainly, predominantly before the auxiliary (Greenbaum 1969, 236f.). 


Earlier work with British subjects had shown that in a declarative 
sentence the intensifier badly was preferred in preverb position while 
in a question sentence-final position was preferred (Greenbaum 1970, 64-66). 


American: subjects however, favor final position for the intensifier badly 


in declarative-sentences (Greenbaum 1974, 11). Two other intensifiers 


were therefore chosen to investigate whether their positional norm was 
affected by the question form of the sentence. The norm for the inten- 


sifiers preatly and utterly has been found to be preverb; word-placement > ‘ 


tests yielded the dominant orders They all greatly admire his courage 
and They all utterly hate that course (Greenbaum 1976, 4, 11‘. On the 


whole, compliance tests b8 and b9, which have sentences almost identical 
to the word-placement norms, produced relatively few noncompliances. 

In b8, two failed to curl the sentence into a question and three trans- 
posed greatly to final position; in b9, four failed to make the required 
ivanetarmatior 6he transposed utterly, and one replaced utterly with 
really. For comoarison, the formulaic adjunct humbly was tested. For- 

_ mulaic adjuncts similarly favor preverb position (Quirk et ai. 1972, 84h). 
There were somewhat more noncompliances: seven failed to produce a ques- 
tion and six transposed humbly to final position. (A numberof lexical 
changes suggest that. state Visjectis objected .to the collocation of humbly 
with present his apologies. ) The evaluation tests gave a fairly hirh 
acceptability rating for’ the questions with greatly and ‘humbly, but. a 
somewhat lower rating for the question with utterly. For all three there 


were a considerable number that thought the sentences dubious. 


IIs DISJUNCTS 


, RNC 
~ Compliance : Task Scores Percent 
al2. He probably stayed late. - ~ question 4,3 59 
al3. They rossibly Yeft early. ; question 28 35 
al. They verhaps came Late. question 6 hl 
bll. Honestly, it did rain the whole day.: Ni: week 21 22 
b12, Wisely, she did mail it on Monday. NS: Tuesday 2? 23 
b13. Proudly, they did march ont of the palace. N's: hall 33 3h 
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Evaluation 


al2. Did he probably stay late? 
al3._-Did. they possibly leave early? 
ali. ‘id they perhaps come late? 


bll. Honestly, it did rain the whole week. 
b12. Wisely, she did mail it on Tuesday. 


12 (358) 


49 (62%) 


b13. Proudly, they did march out of the hall. 30 (31%) 


Probably, 
of doubt as to the truth-value of what is being said (Quirk et al. 1972, 8.82). 
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- 2 
3h (43%) 30 pee 
9 (11%) 21 (27%) 
5 (6%) 2h +708 
8 (8%) 14 (15%) 
18 (19%) 21 (23%) 


29 (30%) 37 (39%) 


ssibly, and perhaps are disjuncts expressing some degree 


Experiments with British subjects have shown that sentences in which these 


disjuncts appear in questions are marginal in acceptability and that probably 


is the least acceptable of the three (Treenbaum and Quirk 1970, 152f.). 


In those exveriments, the time reference in the sentences was future, 


marked by the auxiliary will. Evidence was sought for the suggestion 


that the acceptability of probably decreases markedly when the time ‘ref- 


erence is past, whereas past time reference does not affect the accepta- 


bility of perhaps and possibly (Greenbaum 1969, 153 Note). Tests al2, 


al3, and all, presented the three sentences with past time reference to 


American subjects. The American subjects tended to produce more noncom 


oliant responses for all three sentences, but there is a greater gap be=- 


tween the numbers for the sentence with probably and those for the sen-~ 


tences with perhaps and possibly: 


probably 
nossibly 


perhaps 


RNC Scores 


British 


27% 
25% 
17% 


American 


59% 
35% 
LS 


The difference is more conspicuous for the evaluation results: 


11 


Ororow 


Complete Rejections 


British "American 
probably’ 15% 42% 
possibly --—10%.. 11% 
‘ perhaps 13% 6% 


One of the differences between subject adjuncts and ces ‘disjuncts 
is that the former do not seem to be able to precede an ares auxil- 
dary (Quirk et al. 1972, 8.43). This suggested difference is tested in 
:| al2, which contains the spans disjunct wisely, and al3, which contains 
- the subject adjunct proudly. Honestly in bll is a style disjunct (Quirk 
et ai, 1972, 8.80). It was expected that with respect to this syntactic 
feature wisely would behave more like honest ly than. like proudly. The 
expectation ‘wis fulfilled in the compliance tests, where the results for 
all and al2 are very close. Most of the compliances in all three tests 
* involved omission of the adverb or the rest of the sentence after the 
adverb or patlure: to retain the emphatic auxiliary. In the evaluation 
tests, al2 is approximately intermediate in acceptability ratings for 


the three tests. 


\ TIIs__ TIME ADVERBS 


aa RNC ; 

Compliance \\ Task Scores Percent - 

a3. The students explained the problem soon. wie student 29 36 
alO. Your brothers: like the house soon. ws brother - 39 48” 

be His son despises. the school quickly. . past 27 28 
b5. My friend quickly trusts such neople. past 18 19 
\, b6. Your brother owns the house soon. . past 56 59 
- b7. The student so8n explains the problem. past 19 20 
al5. He can usually explain what they mean. negative 37 46 
al6. He can often write well.’ negative 35° £3 
bl. Hetells always the truth. future... 88 92 
-b2. She vlays quietly the piano. future ‘ 68 71 
b3. They help mainly the old. : future. 26 27 


4 ° 


12 : 
Evaluation ; Ay : + — 2. 9 6 / 
a3. The student explained the problem soon, 18 (22%) 31 (278) 29 38) oy 
alO. Your brother likés the hose soon. .0 84%) 11 (14%) 2 O 
| bhe His son despised the school quickly. 37 (39%) 28 (29%) 31 (32%) 0 0 
| b5. My friend quickly trusted such people. 56 (60%) ' 16 (17%) 20 (21%) 2 2 
b6. ~Your brother owned the*house soon. 9 (9%) 73 (77%) 12 (13%) 1 1 
b7. ‘The student soon explained the problem. 87 (91%) 1 (14%) 7(7%) 1 0 
al5. He.can't usually explain what they mean. 56 (60%) 7 (9%) 16 (17%). O 2 
alf. He can't often write well, -37-(46%) -14-(17%) --29-(36%) 1 0. 
bl. He told always the truth. 19 (20%) 52 (55%) 21 (22%) 2 2 
b2, She played quietly the piano. 4 (4%) 75 (78%) 17 (18%)-0 0 


b3. ‘They helped mainly the old. 45 (47%) 18 (19%) 32 (33%) 1 0 


Quickly is an example of an adverb that can refer either to the speed 2 
of an activity or vrocess or to the speed of the inception of what is 
’ 
being predicated. In the first use it is closer to a manner adverb and 


> ' 
in the second to a time adverb. In its temporal use, quickly belorigs to 


a set, of alverbials that include immediately, instantly, at_once, shortly, 
soon, hefore long, after_a (short) time, Aeibnlin a short time. ANE man- 


ner use can be illustrat ed in 


° 


He ate his lunch quickly (‘ate in a way that took a short time’) 


and the temporal use in 


‘le quickly forzot about the insult ("came to forget’, "started 
° , 


to forget’) 
Ye should also note the corresponding structures for each of the two sentences: 


Ye was qaick in eating his lunch 


_ Ne was quick to forget. about the insult 


If, as with forget, the verb does not refer to an activity or process, 
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* quickly must be temporal. If, however, the verb does refer to an activ— 
ity or process, both interpretations are possible, though usually the \ 
context will in large measure determine the interpretation. In partic- 


ular, communicative verbs are open to the, temporal meaning: 


T don't understand what's going on; he's. telling Ahe story. / 
9S -- -to0-quickly ~{manner) ©. - 5 al 


she didn't like his attitude, and she quickly told him so. - 


(temporal) 


» 


Like quickly in having a temporal inceptive use as well as a manner 


alverb are pradually, rapidly, slowly, suddenly, swiftly. Here are some 


further examples of the temporal use: 
a . 
They slowly realized the significance of his action 
ri 


He suddenly rememberéd that he had a previous appointment 
We should rapidly feel the effects of this devaluation , 
She swiftly began to complain about the heat sl 
They will erad@uais like,their new school 


When he saw the blood spurting from the wound, he quickly 


a phoned for an ambulance 
» They asked for his help, but he swiftly replied that he 
was too busy f° 
They ead the report) and rapidly denied being in any way i 
Z negligent , 
. They noticed his expression and quickly asked him whether 
anything was the matter ee eee d 
The adverb apnears to be attracted initially or before the verb when / 


it is temooral but finally when it is manner (Quirk et al. 1972, 8% 37). 
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dd with relational own. The compliance test results indicate that 


Tests bi and b5 were intended to provide evidence of this tendency. Only _ 
the temsoral interpretation of quickly is admissible with the verbs despise 
aid trust, and it was therefore éxpected that the sentence in b5 would be 
preferred, -since quickly is there preverb. The vreference is shown by 

the lower noncompliance score and the higher acceptability rating for b5. 
The changes made in compliance test b4 also indicate that the position 

of quickly was a major contribution to the unacceptability of the sentence. 
Five subjects transposed quickly to preverbd and two replaced quickly by 
soon and transposed soon to preverb. There were also four replacements 

of quickly hy adverbs that are Appenkabite in final position: eat 
(twice), quietly, now. ‘ty contrast, in b5 there was only one transposi- 
tion (finally) and no renlacements of quickly.: In ‘both tests, some sub- 
jects omitted quickly (bl-15, b5-9) or the whole sentence /bi-1, b5-4), 

and in b5 one subject replaced trusted by mistrusted. The omissions and 
substitutions (soon, mistrusted) suggest that for oe subjects the col- 
location of svxecific verb and adverb may constitute a problem. That would 
also explain the minority of total rejections in b5, where ouickly is 


oreverh, 


In contrast to quickly, the adverb soon always has a temporal incep- 
tive use, whether the verb is an sesh intdiy verb (as in a9 and 67) or not 
(as in al) and b4S), Like quickly in that use, the normal position is the 
preverb position, as is ‘shown by the evaluations for a9-and b7, when the 
only difference in the sanbenede was the position of soon. The rejections 


of the final position were even more numerous in al0, with emotive like, 


the nosition was at Least. partly the nroblem, since there were no trans- 


15 


4 positions of soon in b7 but several in the other three tests (a9-7, al0-3, 


b&-7). However, for all the compliance tests there were a Large number 


of omissions, either of soon alone or of the whole sentence (15 in a9 
and b7, 23 in alO, and 34 in b5). One other frequent correction was the 


change of temporal reference by the insertion of will or would: 
Your brother will own the house soon. 


future reference allows soon to be positioned finally, whatever the for- 


mal means of introducing future reference: 


He'LL be writing to you soon 
Send it to me soon 


T exnect to own the house soon 


The reason for the nositional difference may be that svon with oist ref= 
erence has partly a connective function, linking back to sie previous 
event or state (‘within a short time after that'), whereas sodn with fu- 
ture reference connects only with the time of speaking or writing (‘within 
a short time from now’). Adverbials with a connective function tend to 
appear early within their clause (Jacobson 1964, 151). The connective 
function may also be the explanation for the many omissions in the com- ° 

’ pliance tests, even in the acceptable b7: a sentence containing a con- 
nective item may be felt to be slightly odd in isolation. Even when there 
is no future reference, final position seems also to bé allowed if soon 


is modified: / 


The student. explained the problem ( (much) +00 soon 
Lu pretty soon 
16 
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The explanation may lie in the greater weipht of HhetGdver’s which tends 
to move it to final position, (cf. Jacobson 1964, 106f.). Final position 
is also normal for the en ere for the same reason but also 
- as with future reference — because the connection is made within the 


clause rather than to a previous text: 


T expected 


The student explained the norobLem sooner than } I dia 


In a previous British experiment, subjects were asked to negate the - 


sentences 


He can often explain what they mean 


He can usually write well 


and later to evaluate the negative sentences with the adverb positioned 
immediately after the nerative particle. In was expected that in the 
com liance tests both adverbs would be retained after the negative par- 
ticle and that in the evaluation tests both sentences would be judged 
acceptable, In the event, the sentence with often explain was fully ac- 
; cepted by }%7 of the subjects but the sentence with usually by only 52% 
Tn both comnliance tests the adverb was transposed by some subjects - 
19 for often and 33% for usually. It was suggested (Greenbaum 1959, 

‘ isi. ). that the relatively low acceptability of the sentence with usually 
had nothing to do with the position of usually, but was because the neg— 
ative of He can write well, where can has a characteristic meaning, is 

He inealits write well. If that was nee results for the sentences 


‘ 


“would be similar if the adverbs were exchanged, as in al5 and al6, The 


’ 


or-the-evalnations-tests-are-in-the-expected direction. —The ae 


sentence with usually rose to 49% full acceptance, while the sentence , 


\ 


mannan meer tees Daren eaten 


with often dropned to ,6% In compliance test al6 three subjects substi- 
tuted doesn't, for can't, providing some evidence for the suggestion that 
the normal negation is doesn't and for the explanation of the British | 
results. However, there _— somewhat more transpositions of usually 
(32%) than of often (27%), and it is significant that all but one of the 
bvaienemtietons of usually were to pre-modal position whereas often was 
moved to several different positions, It would appear that a consider- 
albe minority were unhappy with usually in the position after the negative 
particle, and therefore that was an adaltional factor in the acceptability 


rating, so that al5 with can't usually explain did not elicit as high 


vr acceptability rating as can't often exnlain in the British experiment. 


\ 


In bl a tine frequency adverb, always, is positioned between the 
verb and the direct object. » That position is normally avoided by adverbs, 
unless-the direct. object clearly has greater weight than the adverb (cf. 
Jacobson 196h, 142). The sentence He told always the truth was penerally 
considered unaccentable or dubious in evaluation test ble In the corres- 
vonding compliance test aut subjects moved always. Most (79%) placed 
always between the auxiliary and the verb He will always tell the truth. 
Tests b2 and b3 were given for comparison. Quietly in h2 is a manner 
aiverb, also unacceptable between the verb and the direct object. How- 
ever, the rectifications in the compliance test were not the same as for 
bl. The normal position’of. adverbs is final and bat nostbior was selected 
hy 27% for quietly, though no Kaniasee placed always finally; 25% trans- 
nosed quietly to preverb position, The restrictive adjunct main). in bl 


focusses on the direct object. the old. In formal writing adjuncts focus- 


sine on the direct object are often olaced before it, though orevert o- 


sition is commor in soeech (Quirk et al. 1972, 813-15). There wis sreater 
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acceptance for the position before the direct object in b3. _In the com 


pliance test 15% movett mainly to preverb position. 


“Ws ADISCTIVES TN EXTRAPOSED — "TT' CLAUSES 


: Compliance \ . Task ‘Scores Percent 
42%, Tt's presumable that Sylvia will Leave home. N3t sne 10 12 
ee ae : sure that he smokes cigarettes. N5 cigars 9 11 
b18,' Tt's sure that Sylvia will leave home. Not ghe 18 . i 
b19, Tt's presumable that he smokes cigarettes. Na cigars 21 22 
b20. It's certain that she writes poems, N“: novels 5 5 
\ 
Bvaluation - | + = a ef 


a?3. .Tb'S presumable that she will leave home. 67 (83%) 4%) 10 (124%) 


| 1 0 
a2. It's sure that he smokes cigars. 35 (h4%)' 13 tS 30.(37%) 2 1 
_b18 It's sure that. she will leave home. 71 (76%) 9 (10%) 12 (13%) 2.2 
b19. It's oresumable that he smokes cigars. 68 (72%) 7.(7%) 19 (20%) 1 1 
3 (3%) 11 (12%) 0 2 


b?0. It's certain that she writes novels. 80 (85%) 


As an attitudinal disjunct, certainly has a S senanareline it is certain 
that as the superordinate clause of the sentence, but the analogous corres- 
pondences for presumably and surely ne to be of dubious acceptability 
(Greenbaum 1969, 9h-97;: cf. '?" after presumably and surely at end fof 97)« 
The tests in this set, were intended to ascertain if there was experimental 


cvidence for that distinction. Compliance tests a23 with it's presumable 


that and a24 with it's sure that oun a similar number of noncompli- 4 
ances, but in the evaluation tests 83% fully accepted a23 while only 43% 
fully accepted’ a2h, Since the difference between the ‘judgements might 
be due to the difference in time reference = a23 has future reference 
while a? has the present, tense with generic \reference - the tests were 


Me peated with. switched. subordinate clauses in 618 and b19. A control 


sentence with it's certain that was added (b20). The evaluation tests 


19 


al 


show that the time reference in the subordinate clause has a marked effect. 
on the acceptability of the sentence with it's sure that but not on the 
sentence with it's presumable that. It is not clear why there should be 


that difference between the two adjectives or why sure behaves differently 


in that resnect from certain. a ) 
' ’ 

V3  A>TECTTVE CLAUSES 

Compliance . Task Scores’ Percent 
b21. Wise, they turn down the offer. nast 23 al, 

b?2,. Happy as always, she sings to them. past 16 7 
b23. Delighted, she approves of the plan. past 9 9 
b2i,. Unemployed, he calls for their help. past, 12 1? 

Evaluation + - 3 ae 
b21. Wise, they turned down the offer. . 28 (29%) 42 (hy) 25 (26%) 1, 0 
b22. Happy as always, she sang to them. % (79%) 7(7%) 12 (12%) 1 0 
b232, Yelighted, she approved of the plan. 81 (86%) 3 (3%) 10(114 O 2 
b2he Unemployed, he called for their help. 62 (45%) 8 (8%) 21 (22%) 4 1 

This set of tests concerns adjective phrases functioning as verbless 

clauses (Quirk et al. 1972, 5.2h-5+27). In b?1 the adverb wisely - as 

attitudinal disjunct - is available as a substitute commonly expressing 
' \ 

a similar meaning (Quirk et al. 1972, 8.85).— Happy in b2 has the corres- 

poniing adverb form happily, but the interpretation would be different: 

either the attitudinal disjunct ('one is happy: that') or the manner ad- 

junct (‘in a hanpy manner'), In both interpretations the addition of 

as_ always is strange, and in the manner interpretation we would expect 

happily as always in final position. There are no corresponiing adverb 

forms for, delighted in b23 or for unemployed in b2. The two differ in 

~ that delighted has a possible verbal interpretation ("Since the plande- 


lighted her’) as well as an adjectivel interpret.ation,~while unemployed 
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wa 


is isolated from the lexical verb employ by its morphological marking 


(cf. Svartvik 1966, 134f., 1373 Quirk et al. 1972, 5.12=5.15). Since 
an equivalent adverb is available, we might, expect wise to be less accept= 
able than the others. Furthermore, the greater length of the other phrases 
‘(particularly b22) might be expected to increase their acceptability as 
. verbless clauses. The evaluation test results conform to expectations: 
b21 with wise has a distinctly lower acceptability rating than the other’ 
three. b2/, with unemployed has a somewhat lower rating than b22 and b23, 
‘probably because out of a suitable context the logical relationship be- 
tween the verbless clause and the rest of the sentence is not as clear 


as it ds in the other two sentences. 


The explanations are supported by the rectifications made in the 
comoliance tests. In b21, 15 subjects: (16) replaced wise by wisely and 
one gave the verbless clause more weight by negating it, not wise. In 
b2”\ only 5 (5%) substituted the adverb happily, and one of those indi- 
cated that he had interpreted it as a’ manner adverb by moving happily 
as_always to the end of the ae In b23, “ine subject replaced de- 
Lighted by the adverb delightfully, an attitudinal disjunct in the con- 
text ("it was deliehtful'), thereby dhanetvig the meaning. In b24, there 
were several attemnts at showing the relationship between the two parts 
‘of the. sentence: the most explicit was one subject's replacement of un- 
employed iy when he was unemployed; van others substituted being unemployed, 
presumably a causal relationshin; and one restructured the sentence as 
He was unemployed an called for help. Interestingly, one subject sub- 


stituted re-emnloved, nerhaps because the substitution gave a clearer 


logical relationship. 


21 
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VI: . COORDINATION ELLIPSIS 
; RNC 
Compliance Task , Scores Percent 
2) 
al3. John had a headache, so didn't go. Not cold 39 48 
a20. Henry needed money, yet didn't work. N,: food 31 39 
a2l. Did John break the window, but refuse ws he 28 35 
to vay for it?” : 
a22. Did Mary wash the cup, but he refuse to wi: she 53 65 
; drink from it? 
b14. Mary felt sick,. but didn't aeayee Adj: bored 20 al 
b15. Bob became annoyed, and didn't call. Adj: anpry 28 29 
b15, John had a headache, therefore didn't go. N>: cold 63 66 \ 
bl7. Henry needed money, nevertheless didn't N's: foo 69 (oa 
work. 3 
Evaluation + - 2 ? 
al9. John had a cold, so didn't go. 51 (63%) 10 a 13 cee 2 
a20. Henry needed food, yet didn't work. 68 (84%) 4 (5%) 11%) 0 
a2l. Did he break the:window, but refuse 70 (86%) 2 (2%) 6 (7) 3 
to pay for it? . 
a22. Did she wash the cup, but he refuse 38 (47%) 15 (19%) 24 (30%) 3 
to. drink from it? 
bly. Mary felt bored, but didn't leave. 93 (97%) 3 (3%) 0 ) 
b15. Bob became angry, and didn't call. 77 (81%) 5%) 13 (14%) O 
b16, John had a headache, therefore 64, (67%) 13 (14%) 16 (17%) 2 
didn't 206 
bl17. Henry needed food, nevertheless n 52 (55%) 19 (20%) 22 (23%) 1 


didn't, work. 


Tests al}, a20, bl4, b15, b16, and b17 deal with sentences in which 
there is identity of subjects in two clauses and the second subject is 
ellipted. An identical subject is ellipted when the clauses are linked 
by the coordinators and, or, and but; the ellipsis seems to be possible 
for the conjuncts yet and (to a lesser extent) so, but not for other con- 


Juncts such as therefore and nevertheless (cf. Quirk et al. 1972, 9. 3h). 


The results of the evaluation tests did not correspond with expec- 


tations. They distinguished three sets of sentences: (1) bl4, with but, 
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was rated as fully acceptable by almost all; (2) a20 (yet) and b15 (and) 


were piven very hieh ratings; (3) al9 (so), bl6 (therefore), and b17 (never- 
theless) were given distinctly lower ratings, though in each test a maj= 
Heaae fully accepted the sentence as presented. I was particularly sur- 


é 


saléen at. the number who rejected b15 (and) or considered it nO: be duntoads 


* 


The compliance tests, on the other hand, produced the expected three- 
way jistinction in the expected order of acceptability from highest to 
Lowest: (1) bl4 (but) and b15 (and), (2) al9 (so) and. a20 (yet), (3) b16 
(therefore) and bl7 (nevertheless). Details of the noncompliances are 


shown in Table A. 


Some of the rectifications in bl5 (and) explain the lower acceptability 

rating for that sentence relative to the rating for bl4 (but). Six subjects 

replaced and with but and four omitted and. It seems that the logical re- 

lationship between the two clauses was not clear enough or and was felt to. 

be insufficient to convey it. Furthermore, even among the 53 compliant 

responses, 31 omitted the comma oe the clauses as compared with the 

14, omissions in the 41 compliant responses in bly. The evaluation test 

nroduces 3 global evaluation, which does not necessarily focus on the | ae, 
nroblem that interests the investigator. Implausibility and even odd punc-~ 
tuation might, evoke evaluations that are irrelevant to the investigator. 

It is sipnificant, on the other hand, that among the compliance tests b15 
has ie towest, number. of responses in which a subject has been insert2d 

in the second clause. “For the tests with so, therefore, and nevertheless, 
_the most obvious rectification was inssriten of a subject. With yet there ~ —~— ‘ 
was a more obvious renlacement: 11 subjects substituted but, one by (ver- 


haps a hybrid of the initials of but and yet, indicating the subject's 
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vacillation), and one though. 


Tests a2l and a22 concern the acceptability of two interrogative 
clauses linked by but. An earlier British meander (Greenbaum 1949) 
dealt with the ania problem and also comprised, compliance and evaluation 
tests. Ne can compare the two sets of results.’ (Br refers to the cor- 


responding British tests. ) 


+ - ? 
a? BAS 2%, 11g 
Br2l mt 11% 15% 
an? 47% 194% 3% 


Br 22 45% 28%, 26% 


The results are alike in that there is a considerable difference in the 
accentability of the two sentences. al, where the subjects of the two 
clauses were identical and the second subject was deleted, evoked a far 
‘higher acceptability rating than 22, where the two subjects differed and 


the second subject was necessarily retained. 


In the British compliance tests, subjects were asked to make .into 


questions the sentences 


-. John broke the window, but. he refused to. pay. for ite 


She washed the cup, but he refused to drink from it. 


, 
a 


The compliance tests in that. experiment contained a task that introduced 
the putative oroblem of acceptability. In the present compliance tests 
the putative problem was there in the presented miestion: the task - 


change of noun to pronoun in the subject. of the first clause - was merely 


adistractor, Cnbjects are less likely to introduce a deviance than to 
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retain a deviance in the sentence presented to them (Greenbaum and Quirk 
1}49, 79%). “Accordingly, there are far fewer noncompliances in the pres- 
ent experiment than there had ‘been in the British experiment. (Br21 &9% 

and Br2:) 73%). “The changes in the present experiment are shown in Table 3, 
The major means of evading the problem of coordinating two questions by 
‘but was to omit the second clause, but the same effect was achieved by 
making one or both of the coordinated clauses declarative, by substituting 
another linker, or by omitting but. A few inserted the auxiliary in the 
daha clause, although it is doubtful that the change improved the sen- 
tence, Several omitted he in the second clause of a22, thereby making 

the subjects of the two clauses identical, a change that shifted a22 to 


e 


the tyne exemplified in 421, the more acceptable analysis. 


VII: JUMBLED SENTENCES 


. RNG 
Comoliance Task Scores Percent 
a25. every the man day her yisited’ present 64 7) 
a?h,* old that woman car his drove present 45 89 
a27. each at he time she smiled present 46 81 
a?8, every that each at he drove present 73. 90 
evaluation ; | + - 2 2 / 
; ; a 
a25. Every the man day her visits.. 0 77 (95%) 2(2%) 2 O 
a24, Old that woman car his drives. 0 79 (98%) O 2 0 
a27. Each at he time she smiles, 2 a 79 (98%). 1 (1%) 1 'O 
-1 (1%) 77 (96%)° O 2° 1 


a28, Every that each at he drives. . 


The four sequences in this set are clearly unacceptable, ani the 
near unanimity in the evaluation tests was exnected, as was the Lack of 


’ . . 
differentiation in the reaction to the four sequences. However, though 


ca, | . 4 > , - - ’ ; 

none of the.sequences constitutes an Fnglish sentence, there are differences 
between them, ani it was expected that the differences would produce Oa 5 
ferences in the resnonses in the compliance tests.’ The words in a?5 and a2h 


can be rearranged to form acceptable Inglish sentences. There is more than 


one possibility for rearranging a26: | | 
That old woman drives his car i 


That: woman drives his old car f 
His old woman drives that car 
His woman drives that old car 


wa 


The multiple ambieuity in the unjumbling of a26 was expected to cause ane 
lifficulty than the unique unjumbling of 425. inierary it was aay noticed 
that in fact a25 allows for two orderings: every day can be liead initially 

.or finally, thoush the choice does not involve 3 change in cognitive meaning: 


Every day the man visits he 
The man visits her every day 


Furthermore, a25 presents a sequence that could be interpreted as jumbled 


subject followed by jumbled predicate: 


old that woman —» that old woman 

ear his drove -» drove his car 
127 was expected to be worse that a25 and 126, since not only was there 
more than one possible rearrangement, but a morphological rectification 
would be required to produce an acceptable sentence: either he or she 
would need to be chanzed to the objective form. Finally, a28 could not 
be changed into an acceptable sentence by rearrangement and morphological 
rectification. Thus, the first three sentences contained sets of words 


that could constitute acceptable sentences either by surface rearranrement 
» * 7 


26 


-@ | tg - . 26 
alone of the words or by rearrangement together with a superficial change 


of case‘form, whereas a?8 would require more radical changes: ‘severdl * 


lexical changes in the appropriate grammatical categories. 


One surprising result was that a number of responses were fully com- 
pliant; that is to ‘say, the subjects reproduced the given string after 
having changed the Gana,” The first three tests evoked a similar number 
of compliant responses: 17 (21%), 16 (20%), 15 (19%) respectively; there 
were fewer compliant responses in 328, presumably because the absence of 
underlying connections throughout the sequence placed a greater strain 


on the short-term memory. coo Meg 


~~ ’ 


A number of responses unjumbled the sequences to produce acceptable 
sentences, at the same time making the required tense change. This was 


of course possible only for the first three tests: 


a25 = 18 (224%) a2 -= 9 (11%) = =a27, = +~8 (104) 
| ( 

In this respect, a25 is clearly differentiated from a26 and a27. Of the 
two possibilities for every day, Ay subjects chose initial position and 
7 final position. Despite the multiple possibilities for a26, all 9 un 
Jumblings gave the sentence That old woman drives his eae, presumably 
because the sequence in the jumbled string made that sentence the obvious 
choice. There was no obvious choice for a27; four renenanganente were 
select.ed, depending on whether he or she was chosen as subject and where 
each time was oositionel: 

She smiles at him each time {3) 

Fach time she smiles at him (2): 


Each time he smiles at her (2) 
‘He smiles each time at her {1}, 
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The results of the compliance tests suggest that at least) some sub- 


jects can perceive and reproduce a syntactic structure despite a deviant 
linear order of the constituents. 26 succeeded in unjumbling at least” 
one of the three sentences, 7 unjumbled two sentences, and 1 unjumbled 
all three. These numbers would be considerably increased if we took into 
account partial unjumblings or if we ignored other changes (insertions, 


omissions, or substitutions) that were made concurrently, 


. 
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TABLE A 


CONJUNCTION 
INSERTED 


CLAUSE 
OMITTED 
OR MADE 


FAILURE TO 
RESPOND 
NONF INITE 


ee fof PCE EP 
ee ff ft Pp Pre 
Ee OO 
a 
a 
reat [> [sf] |= Pp 


OMITTED | OMITTED, 
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TABLE B 


COORDINATED SECOND 
CLAUSE(S) MADE CLAUSE 
DECLARATIVE | SUBORDINATED 


(+and: 2) 
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; door two of the compliance tests one subject was missing: hn was 


80 for a20 and 95 for b6é, 


"The female:male ratio was 59:22 for UWMa and 66:30 for UWMb. Sub- 
jects were asked to write down where they had spent most of the first 
fifteen years of their life. The geographical distribution wast 

UWMa: Wisconsin 73, Illinois 1, Indiana 1, Pennsylvania 1, 
Washington 1, the South 1, mixture of places 2, none 
given 1 


UWMb: Wisconsin 83, Illinois 3, Michigan 2, Iowa 1, New 
Jersey 2, New York 1, none given 4 


Subjects specialized in a wide range of disciplines, though mainly within 
the Humanities. They took part in the experiments voluntarily for a small 


payment. 


Athere is evidence that sequence and position in the battery can 


“affect, results (Greenbaum 1973 and in press a). 


‘ hth the exneriments reported on in Sees and Quirk 1970 the mater- 
ial was presented orally and the responses in writing. Oral presentation | 
may Be necessar/ where prosodic information is relevant, but it has ine 
disadvantage that the material and the responses are not in the same medium, sas 


introducing a variable that may affect“results. 


The sliies were projectei from a carrousel slide projector. A Kodak 
‘sound-svnchronizer was used to coordinate the projector with a stereo- 
taperecorder, This unit enabled the experimenter to record and play back 


sienals on one track of the stereo tape, while the other track was used 


‘ 33 ite tee rede a eee 
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for instructions. The signals, which were not audible to the audience ® 
on the playback, activated the carrousel, so that a slide was replaced 
after three seconds by a cardboard square that blacked out the projector; 


after 15 seconds the square in turn was replaced by the next slide. 


» 


SHardly and practically belong to different subcategories of down- 
toners (Quirk et, cs 1972, 429) and may watt differ in their positional 
norms when more than one auxiliary is present, As a negative minimizer, 
hardly verhans always selects the position after the first auxiliary; 


as an approximator, practically perhaps always selects the preverb position. 


- 


The evaluation tests were the same in both the British and American 


experiments, excent that John was the subject in the first experiment 
and not he and also the second experiment allowed a ‘don't know’ response 
as well as a "somewhere between’. response. The two responses are conflated 


to allow a more direct comparison between the two sets of results. 


a 
The few responses other than complete rejection must’ be considered 


facetious. 


‘Change of past tense to either the -s or base form was’ counted as 


compliant, since in non-sentences there could hardly be a requirement, 
for number concord. However, almost atl compliant responses gave the 
-s form, vresumably because none of the sequences contained a plural noun: 


there were two base forms in each of a25, a26, and a27, and one in a8, 
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ce 4 | TABLE 1 
COMPLIANCE TESTS: UWMa 


Test Sentence 


The price has practically doubled, 


‘The price practically has doubled. 


He could hardly sit still. 

He hardly could sit still. 

He badly needed the money. 

I despise him utterly. 

T utterly despise him. 

His arrival was utterly expected. 

The students explained the problem soon, 
Your brothers like the house soon, 


“ The car certainly broke down. 


He probably stayed late. 

They possibly left early. 

They perhaps came late. 

He can usually explain what they mean. 
He can often write well. 

You will surely believe him. 

You will certainly want this. 

John had a headache, so didn't po. 
Henry needed money, yet didn't work. 
Did John break the window, but refuse to 
nay for it? 


Did Mary wash the cup, but he refuse to 


drink from it? 

It's presumable that Sylvia will leave 
home. 

It's sure that he smokes cigarettes. ° 
every the man day her visited 

old that woman car his drove 

each at he time she smiled 

every that each at he drove . 
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: student 
nts brother 


question 
question 


N's: she 


Ns cigars 
present 
present 
present 
present 


RNC Scores 
n=81 % 
16 Ro 
43 .- 537 
ES p 3 
h2 52 
14 17 
13 ins 
iL. se 8 
al, 30 
29 36 
eS) 48 
/43 ee 
48 59 
28 35 
36 Lb 
37 46 
a5 43 
71 88 
73 90 
39—Clt«ss COB 
31 39 
28 35 
ee: 65 
10 12 
9 11 
6h fe 
65 80 
66 81 
73 90 
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TABLE 2. 


COMPLIANCE TESTS: YWMb ’ 


Test Sentence 


He tells always the truth. 

She plays quietly the piano. 

They help mainly the old. 

His son despises the school quickly. 

My friend quickly trusts such, people. 

Your brother owns the house soon. 

The student soon explains the-problem — 
They greatly admire his courage. 

They utterly hate that course. 

He humbly presented his apologies, 
Honestly, it did rain the whole day. 
Wisely, she did mail it on Monday. 
Proudly, they did march out of the palace. 
Mary felt sick, but didn't leave. 

Bob. became annoyed, and didn't call. 

John had a headache, therefore didn't go. 
Henry needed money, nevertheless didn't 
work. . ‘ 
Tt's sure that, Sylvia will leave home, 
It's presumable that he smokes cigarettes. 
It's certain that she writes poems. 

Wise, they turn down the offer. ed 
Happy as always, she sings to them 
Delighted, she approves of: the plan. 
Unemployed, he calls for their help. 
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Task 


future 
future 
future 
past . 
past 
past 
past 
question 
question 
question 
Nge week 
N 


: Tuesd 
N*: all 


Adj: bored 
Adj: an 
N2:' cold 


N's food 


RNC Scores 
n=96 
BR 92 
68 8 
2A 27 
27° 28 
18 19 
56 59 
19 an 
8 8 
11 11 
15 | 16 
21 22. 
22 23 
33 3 
20 21 
28 29 
63 66 
69 72 
18 19 
21 22 
a 5 
on 2k, 
16 17 
9 9 
12 12 
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TABLE 3 


EVALUATION TESTS: UWMa 


Test Sentence 


The prices have practically doubled. 
The prices practically have doubled. 
They could hardly sit still. 


.They hardly could sit still. 


They badly needed the money. © 

T despised him utterly. 

IT utterly desnised him. 

His arrival is utterly expected. 

The student explained the problem soon. 
Your brother likes the house soon. 

Did the car certainly break down? 

Did he probably stay late?-—. 

Nid they possibly leave early? 

Did they perhaps come late? 

He can't usually explain what they mean. 
He can't often write well. 

You won't surely believe him. 

You won't certainly want this. 

John had a cold, so didn't go. 

Henry needed food, yet didn't work. 

Did he break the window, but refuse to 
pay for it? 

Did she wash the cup, but he refyse to 
drink from it? 

It's presumable that she will leave home. 
It's sure that he smokes cigars. 

Every the man day her visits. 

Old that woman car his drives. 

Each at he time she smiles, 

Every that each at he drives, 
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TABLE 4 


EVALUATION TESTS: UWMb 


Test Sentences 


He told always the truth. 


She played quietly the piano. 

They helped mainly the old. 

His son despised the school quickly 

My friend quickly trusted such people. 
Your brother owned the house soon. 

The student soon ‘explained the problem. 
Do they greatly admire his courage? 

Do they utterly hate that course? 

Did he humbly present his apologies? 
Honestly, it did rain the whole week. 


-Wisely, she did mail it on Tuesday. 


Proudly, they did march out of the hall. 
Mary felt bored, but didn't leave. 
Bob became anrry, and didn't call. 


John had a headache, therefore didn't go. 


Henry needed food, nevertheless didn't 
work. 


‘It's sure that she will leave home. 


It's presumable that he smokes cigars. 
It's certain that she writes novels. 
Wise, they turned down the offer.. 
Happy as always, she sang to them, 
Delighted, she approved of the plan. 
Unemployed, he called for their help. 


ov 


KFPnNCOCrFPOCORPUMEFrRPRrNOFONRD 


FOrRrFOFrFDND 


NF RPOOWOWNFEORPNOCOOND ™ 


Pnoconrn 


37 


awakwa’s 


APPENDIX IT 


ov 


2 


oS INSTRUCTION SHEET FOR COMPLIANCE TESTS 


You will be shown at regular intervals of time a slide containing 
an instruction and a sentence below the instruction. The instruction 
will tell you what task to perform on the sentence. There will be sev- 
' eral kinds of tasks, all of them quite simple to do. You will be asked 
to replace one word by another. For example, one slide might show: 


‘ ‘ 
Replace he by they 


\ 


He wants a drink. 


You would then write down They want a drink, You will also-be asked to “3 
change the tense of the verb: into the past, present, or future. For , 7 
example, if you were told to turn the verb into the present in the sentemce: 


My friend often wrote to me. 
you woul.i respond with My friend often writes to me. Other tasks require 
you to make a sentence into a question or to make it negative. If you 
were asked to make this. sentence into a question: 
? 
They play well. 
ee , ‘ { 
vou would simoly write Do th lay well? And if you were asked to make 
it nepative, you would put % ey don't play well. ; 
Bach slite-wiIl be shown for only a few. seconds, so you will: have 
to memorize the instruction ani sentence. You should only start writing 
your response when the instruction slide switches off. When you hear 
the work Next it means that the next slide is being shown. If you are 
not. already watching the screen yo st immediately look up and read 
the next slide. Hach response eee on a separate page of the booklet — 
in front of you. 2 an 
There is one last thing I.should mention. Sentences heard in iso- 
lation often sound strange. I must emphasize that you should make only 
the changes that. the instructions specify. 


The first four slides are intended to give you practice in the tasks 
ani in the time you will be allowed for the performance of each task. 
You should write your responses for the practice slides on the first four 
pages Of the booklet which are numbered a, b, c, and d. ' 


Tf these instructions are not clear, please ask me. 


- 
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INSTRUCTION SHEET FOR EVALUATION TESTS 


This time you will not be shown slides. dl 
\ 

The booklet in front of tau contains a sentence on éabk pagee I 
shall ask you to look at each sentence in turn ani make a quick judgement. 
as to how natural and normal it seems to you. If you think a sentence 
is verfectly natural and normal, put a plus (+) next to it.| If you think 
it is wholly unnatural or abnormal, put a minus (-). If .you think it 

is somewhere between these extremes ('a bit dubious', perhaps): put a half 
' (,). And if you are not sure what to put, then put a question mark (7). 
The scale is given at the top of each page as a reminder. 


As before, when you hear the word Next you must turn over the page. 
You will have only a few seconds to write down your response, in order 
to ensure that you aré giving an immediate reaction. No practice will 
be given. 


_ If these instructions are not clear, please ask me. 
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